ANL-HEP-PR~95-66 
MSUHEP-50925 



September 1995 



Detecting a Light Stop from Top Decays 
at the Tevatron 

S. Mrenn;^ 

High Energy Physics Division 
Argonne National Laboratory 
Argonne, IL 60439 

and 

C P. YuanQ 

Department of Physics and Astronomy 
Michigan State University 
East Lansing, MI 48824 



Abstract 

We study the possibility of discovering or excluding a light top squark (stop) ti based 
on top quark decays in the ti events produced at the Fermilab Tevatron. In particular, 
we consider the Minimal Supersymmetric Standard Model with the sparticle spectrum 
m ± + TTif), M\Y + m^o + mi, > mi > m^o + nic, where Xi is the lightest neutralino, 

Ax 1 i A, ]^ 

SO that t tiXi ^'^d ti cxi- All other sparticle masses are assumed to be heavier 
than mt- Such a spectrum seeks to explain the experimental values of Q!s(Af^), Rt and 
Alr obtained from LEP/SLC data. We find that the prospect to observe a light stop 
via this channel at the Tevatron is very promising. 
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1 Introduction 



A recent analysis of the strong and electroweak parameters extracted from LEP/SLC 
data has shown that there is better agreement between theory and experiment for the 
Minimal Supersymmetric Standard Model (MSSM) with light superpartners than for the 
Standard Model (SM) alone j^]. If the superpartners of the MSSM are light, then new 
top decay modes can exist. There are many compelling reasons to believe that the lightest 
superpartner is the lightest neutralino Xi (see reference Q for a review.) A reconciliation of 
the strong coupling measurement at the scale Mz, as{M'^), the observed branching ratio of 

— > bb, Rb, and the left-right asymmetry measured at the SLC, Alr, is suggested by the 
MSSM where the lightest top squark (stop) ii, the lightest chargino > and the lightest 
neutralino Xi have masses below rrit, while all other superpartners are relatively heavy. As 
shown in Fig. 2 of Ref. M, a large m ± would preferentially require the branching ratio 
(BR) of t ^ tiXi to be small. (The small branching ratio of any non-SM decay mode of the 
top quark is inferred from the current top quark data at the Tevatron. This will be shown 
in Sec. 3.) Over a large range of this parameter space, m^± > m^-^ (see Fig. 1 of Ref. ||l|). 
Therefore, the scenario arises where t — > iiXi provided that mt > +m^o. Furthermore, 
if m^-j < m^± + mb, and Mw + m^o + rrih > m^-^ > m^o + tjic, then the dominant decay of 
ii is ii -^cxi §. This is a flavor-changing-neutral-current decay. 

Also recently, an analysis has been performed by the D0 collaboration to exclude light 
stop squarks from the jet and missing transverse energy signature expected from stop squark 
pair production The D0 analysis relies on the large cross section for pair production 
of light stop squarks via the partonic processes qq,gg and the distinctive final state 

iiil ccxiXi when m ± +mh > mr . The signature is two acollinear jets and large missing 
transverse energy (^t)- This signal is overshadowed by the background, however, when the 
c-jet and/or spectra becomes soft. As a result, the D0 analysis excludes the (mj^,m^o) 
values inside the region formed by joining the points (40,0), (60,30), (95,40), (110,20), (85,0) 
and (40,0) GeV. On the other hand, this region is excluded in a model independent fashion 
once mi_^ and m^o are specified. Here, we propose a method to improve the stop mass limit 
or discover the stop squark by studying the decays of the top quark to a stop squark and 
the lightest neutralino. 

Alternatively, a light stop discovery or exclusion can result from analyzing the decay 
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t ^ iiXi ~^ cxiXi- We propose a search for this decay in ti production with the associated 
standard decay t — > bW~ (and the charge conjugate final state). This final state provides 
the distinctive signature £^ b j ^t, where £ = e or and j is a non-6-jet. Demanding 
a high~pT, isolated lepton in the central rapidity region of the detector guarantees a high 
triggering efficiency and reduces backgrounds. Also, since we demand a leptonic decay of 
the W boson and because of the t cascade decay to a charm jet and neutralinos, the 
spectrum is harder than for direct stop pair production. 

The outline of this paper is as follows: In Sec. 2, we show how the CDF and D0 top 
quark data set an upper bound on any non-SM decay mode (any mode other than t bW) 
of the top quark. Hence, BR(t —>■ tiXi) is bounded from above. In Sec. 3, we explain 
the details of defining the signal and reducing potential backgrounds for observing stop by 
studying tt events. Discussion and conclusions are presented in Sec. 4. 

2 Upper Bound on The Branching Ratio of Non— SM Decay 
Modes of The Top Quark 

The existence of the top quark is now firmly established |^]. Kinematic reconstruction 
of the decay products of the top quark in the decay t bW~^ — > bjj (and the charge 
conjugate decay) suggests a top mass mt = 176 it 8 it 10 GeV from the CDF data and 
rrit = 199]i]2i ^ GeV from the D0 data. Both experiments have reported production 
cross sections, which are a function of the assumed top mass used in the analysis. It is 
important to remember that these experiments have optimized their search for the process 
pp tiX — > bW~^bW~X , so they actually report the product of the top production cross 
section a^j and the branching ratio squared 6^, where b = BR(t bW). Based on single- and 
double-6-tagged events, CDF has also reported a measurement of & @. Finally, progress 
has been made in understanding the SM prediction for the production cross section in 
which the effects of multiple soft-gluon emissions have been properly resummed. 

Since the measurement of the cross section obtained from the "counting" experiments 
(counting the observed total ti event numbers in various decay modes) and the measurement 
of the mass of the top quark (obtained from reconstructing the invariant mass of the top 
quark) are not strongly correlated, one can combine these results to find the best fitted values 
for mt and a^j Using these results, we construct a function for = mt— 176 GeV, cj^. 
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and 6^: 



^ \12.8J ^\ 29.7 J ^[ 5lnacDF J 

In the above equation, we have taken the quadratic sum of the statistical and systematic 
errors for measuring nit. crcDF and (Td0 are functional fits to the observed CDF and 
D0 a^j X 6^, cjth is a functional fit to the theoretical production cross section, ft^op is the 
measured BR(t bW), and all 5's are errors on these quantities, as listed below: 



6 In (TCDF 



Ino-cDF = ln(7.60) - 3.17 X lO-^m* - 3.23 X lO-^m^ - 2.94 X lO-'^m^ 
r |0 7.6pb 

1 ^ (^tt> 7-6pb 
lnc7D0 = ln(8.52) - 1.45 x 10~^m^ + 8.87 x W'^ml 
(51nc7D0 = fl 

Inath = ln(5.38) - 3.20 x lO^^m* + 3.65 x IQ-^ml 
(51ncJth = -1 
^CDF = -87 

f .32 b< .87 
I .18 b> .87 ■ 



(56CDF 



Finding the minimum value Xmin yields nit = 168.6^3;o GeV, a^j = 7.09l;g2 pb and 
b = imtll-fl At the 95% confidence level (C.L.) 0, 6 = .74. This number, then, gives us 
an upper limit on BR(t X), where X ^ bW. From the results of the fit described above, 
we conclude that BR(t X) for X / bW has to be less than ~ 25%. 

Some comments are in order. We have assumed that the experiments observe t bW, 
where a fraction of the b quarks have been tagged. However, there might be non-SM decays 
involving 6-quarks, such as t ^ bH^, where H'^ is a charged Higgs boson. Unfortunately, 
there is at present no way to exclude such a scenario for the data used in the fit described 
above when the mass of is about equal to Mw- The counting experiment measurement 
of is sensitive to all events with a 6~jet plus additional jets in the final state that satisfy 
a certain set of cuts. The top mass measurement only uses those events from the counting 
experiment satisfying a M\y mass constraint. However, some of the events in this mass 

^ The theoretical prediction of CTj-j is 6.83 pb for rut — 168.6 GeV. 

*We varied the parameter until the value increased from Xmin by (1-96)^ units. 
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distribution are background events, which are subtracted statistically using the background 
estimated by the counting experiment. Therefore, we cannot define a subset of events that 
is background free and excludes non-SM decays of the top quark containing a 6-quark. 
On the other hand, the mass distribution of the non-5-jets for the counting experiment 
is consistent with that expected from a W. We continue our current analysis using the 
assumption that the experiments do only measure the bW final state. With a larger ti 
data sample in the near future, it would be better to use double-6-tagged events (from both 
I + jets and dilepton samples) for the fit. 

In the following section, we study how to directly observe the non-SM decay mode of 
the top quark t tiXi ~^ cxiXi determine the minimum branching ratio of this mode 
to be detected at the Tevatron for a given set of the sparticle masses m^_^ and ?Tt^o. 

3 Detecting Stop Squarks in the Decay of Top Quarks in tt 
Pairs 

In this section, we consider the MSSM models in which rrit > +m o and m ± +mb, 
M\y + m^o + nif, > m^^ > m^o + rUc, and all other superpartners are heavier than mt- 
Hence, the dominant decay of ii is ii cxi 0]. Since the branching ratios of the new 
decay modes are small (< 25%) compared to the bW final state, most top quarks decay in 
the standard fashion (see Sec. 2). As a result, we can use the 6-quark and a high-p^^ lepton 
to tag ti production. The non-SM decay of the top quark t — > iiXi ~^ cxiXi provides an 
additional jet and missing transverse energy. The signature of the ti events of interest is 
thus iui) + b + j +^T- 

Throughout this study, we assume the top mass is 175 GeV. The top quark pair 
production cross section is given by the QCD calculation, (y^j{mt = 175 GeV) = 5.52 
pb For each model studied, we determine the detection efficiencies for the signal 
cxiXi)^(^ bW~{-^ i^iye)) (and the charge conjugate final state) and the backgrounds. 
The intrinsic backgrounds are t{-^ bW+{-^ X))i{-^ 6VF"(^ i^i'e)), W-{-^ i~i^e)X, (and 
the charge conjugate final states) and i'^i^)X. For the signal rate, we include 

£ = e and /i. For the background processes, we include i = e, fi, and r to account for 
the possible large background from r decay. We note that can be faked if any addi- 
tional jet or lepton escapes detection. The expected background event rate from T^+jets, 
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Z+jets, etc. is calculated in the SM using PYTHIA 5.7 The W/Z + jets backgrounds 
are estimated from the W/Z + parton processes with a minimum pT = 20 GeV. (The 
other backgrounds coming from a jet faking an isolated lepton with high pT can be ignored 
after demanding also a large ]/]t in the event.) Signal events were generated for a set of 
(mj^,m^o) points (see Table 1) beyond the D0 search limit using an extended version of 
PYTHIA 5.7 pO|. 

Because of the presence of two neutralinos in the final state, we expect that the signal 
will have a harder ]/Jt spectrum than the backgrounds. Also, the correlation between the 

and the lepton momentum in pure W decays, as observed in the transverse mass my 
distribution, should not be present in the signal. The transverse mass mx is defined by 
the expression = 2pip^T{^ — cos A0£^), where Acpiiy is the azimuthal angle between the 
lepton i and the-^j- direction. Finally, the hadronic activity should be lower for the signal 
than for the ti background. We find that the following cuts enhances the signal with respect 
to the backgrounds: 

• p^f> > 20 GeV,|r/W| < 1. (I) 

• -^T > 60 GeV. (II) 

• p^'^ > 15 GeV,|r/(j)| < 2. (I) 

• njets = 2. Jets are defined by summing the transverse energy Et in a toy calorimeter 
within a cone size R = .7 so that the jet transverse energy Eij, > 15 GeV. (Ill) 

• mT > 110 GeV. (II) 

• Fake discrimination: ^^(vr — A<f)j^,y)'^ + (Ac/ijjiy)^ > .5, where ji and j2 are the 
highest and second highest Et jets and z/ is the^x direction, and A(f)ji, > .1 for all j. 
A(j)jy is the azimuthal angle between the jet j and the I^t direction. (I) 

The cuts are separated into 3 sets (I-III) to show the behavior of the signal and background. 
Set (I) includes the minimal cuts-^T > 20 GeV and rijets ^ 2. The effect of these cuts are 
illustrated in Table 1 for 11 signal (m^^ , rn^o) points and the 3 major backgrounds. For clar- 
ity, we have broken down the ti background into three explicit final states: 66(e^, /i^)z^jj, 
bbT^ujj, and hbi^vt^u, where i = e,/j, and r. We find that the major background comes 
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With Larger rj Acceptance 


(GeV) 


(GeV) 


I 


II 


III 


I 


II 


III 


50 


20 


.229 


.094 


.068 


.353 


.140 


.103 


50 


30 


.208 


.088 


.063 


.332 


.131 


.097 


50 


40 


.154 


.073 


.056 


.259 


.104 


.075 


60 


30 


.226 


.095 


.071 


.319 


.127 


.092 


60 


40 


.201 


.086 


.065 


.286 


.116 


.085 


80 


40 


.235 


.100 


.075 


.286 


.110 


.078 


80 


60 


.186 


.081 


.060 


.218 


.097 


.072 


90 


50 


.243 


.102 


.076 


.342 


.132 


.095 


90 


70 


.174 


.082 


.062 


.250 


.107 


.078 


100 


40 


.248 


.102 


.076 


.357 


.137 


.101 


100 


60 


.239 


.100 


.076 


.332 


.129 


.095 


tt a 


= 5.52 pb 


.150 


.011 


.006 


.193 


.013 


.006 


bb{e^ 




.375 


.004 


.0 


.506 


.005 


.0 


bbT 




.001 


.0 


.0 


.001 


.0 


.0 


bbl^i^i^u 


.347 


.095 


.005 


.388 


.107 


.005 


ZX a 


= 105 pb 


.002 


< 2 X 10-5 


< 2 X 10-5 


.004 


< 2 X 10-5 


< 2 X 10-5 


WX a 


= 775 pb 


.043 


1 X 10-5 


1 X 10-5 


.081 


1 X 10-5 


1 X 10-5 



Table 1: Efficiency of Cuts (I-III) for Signal and Background. 

from the dilepton decays, bbl'^vP'v, where one lepton escapes detection. Note that the sig- 
nal detection efficiencies es are about the same, ~ .06 — .08 for various choices of (m^^, m^o) 
points. Also in Table 1, we present similar results using a wider pseudorapidity range: 
|7^W|^ < 2.5. We find that the detection efficiencies for the backgrounds do not change 
significantly, while the signal efficiencies increase by about 30%. 

Given the efficiency for detecting the signal es and the backgrounds ee, their respective 
rates are a function of the branching ratio BR(t cxiXi) = ^x- For the models considered, 
there are no other "new" decay modes of t, thus BR(t — > bW) = l — bx- The signal rate is 
(T^j X 2 X 6x X (1 — ^x) X 2/9 X es, where the factor of 2/9 accounts for the e and /x decay 
modes of the W. The background rate from tt is a^j x (1 — 6x)^ x ^tv "^^^ other background 
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rates are simply a product of the production cross section and their efficiencies. ^ Comparing 
the data with these predictions, one can then set an upper bound on bx for any given {m^_^, 
m^o), and, therefore, can constrain the predicted allowed models from Ref. [Q| if no signal 
is found. 

From the discussion in Sec. 2, we conclude that bx < 25% at the 95% C.L. inferred 
from a global fit to the CDF and D0 data (assuming the entire data sample to be t — > bW 
events). Here, we would like to know the minimum bx that can be directly measured (in 
contrast to that inferred from fitting) by detecting the ti pair events at the Tevatron for a 
given integrated luminosity (£) of the collider, if we demand a 3-0" effect. For simplicity 
(later, we perform a more thorough analysis), let us consider only the major background 
from the SM decays of ti pairs. Define the number of signal Ns and background Nb events: 

Ns = C X a^j X 2 X bx X {I — bx) x 2/9 x es , 

Nb = C X a,j X {I - bxf X e^j. (1) 

Assuming that Gaussian statistics are applicable, a 3-a effect of the signal over background 
requires 

4/9 xbxx JC ■ a^j^ > 3 . (2) 



VNb 

Taking a^j = 5.5 pb, C = 2fb~^, es = 0.1 and e^j = 0.01, the above equation gives bx > 6%. 
Substituting bx into Eq. 1, one would expect to observe approximately Ns = 30 and 
Nb = 100 events in the 2fb^^ data sample if BR(t cxiXi) = -06. Although the ratio 
of signal to background is about 1 to 3, the distributions in mx for the signal and the 
background events are very different. A few examples of niT distributions for the signal and 
background are given in Fig. 1. The distributions shown have passed all cuts I~III except 
for the rriT cut, and have been normalized to have the same unit area. The tt background 
is denoted by large hatches, VF+jets with small hatches, and three representative signal 
points {m^_^, rri^o) have clear regions outlined by solid ((50,30) GeV), dot-dashed ((90,50) 
GeV) and dashed ((100,60) GeV) lines, my is larger for a heavier Xi and, in that case, the 
background event can be easily distinguished from the signal event. 

Since the detection efficiency of the signal is not sensitive to the masses of ii and Xi) the 

limit on bx can either confirm the MSSM predictions by finding a stop squark or exclude 

^As shown in Table 1, after the cuts I-III, the backgrounds £'^£~)X and W^{^ £^ui)X, where 

£ — e,jj,, and r, are 2.1 fb and 7.8 fb, respectively. 
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50 100 150 200 250 300 

Transverse Mass (GeV) 

Figure 1: Transverse Mass Distribution for Signals and Backgrounds 

the corresponding parameters of the model. The branching ratio that can be probed for 
200 pb^^, 2 fb^^, and 10 fb^^ is listed in Table 2 including all backgrounds and using 
Poisson statistics where applicable. To summarize Table 2, the worst bx reach for the 
models considered is .45, .10, and .04 for 200 pb~^, 2 fb~^ and 10 fb~^. With the increased 
pseudorapidity coverage, the reach is extended to .33, .08, and .04 for 200 pb~^, 2 fb~^ and 
10 fb~^. The value of bx reachable in the present data sample is comparable to the indirect 
limit from the cross section and mass measurements (see Sec. 2),^ and clearly consistent 
with the measurement of the branching ratio from CDF. 

4 Discussion and Conclusions 

From a global fit to the available data for the top quark mass, production cross section, 
and SM branching ratio and the predicted top production cross section, we have determined 

the allowed non-SM branching ratio for top quark decay. This branching ratio is bounded 

® The 3-cr bound on b from the global fit discussed in Sec. 2 is .6f . Consequently, the bound on bx is 
.39. 
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Luminosity 
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With Larger t] Acceptance 


(GeV) 


(GeV) 


200 pb^i 


2 fb-i 


10 fb-i 


200 pb-i 


2 fb-i 


10 fb-i 


50 


20 


.33 


.08 


.04 


.22 


.06 


.03 


50 


30 


.35 


.09 


.04 


.22 


.06 


.03 


50 


40 


.45 


.10 


.04 


.32 


.07 


.03 


60 


30 


.33 


.08 


.04 


.23 


.06 


.03 


60 


40 


.33 


.08 


.04 


.26 


.06 


.03 


80 


40 


.32 


.07 


.03 


.30 


.07 


.03 


80 


60 


.39 


.09 


.04 


.33 


.08 


.04 


90 


50 


.31 


.07 


.03 


.22 


.06 


.03 


90 


70 


.36 


.09 


.04 


.30 


.07 


.03 


100 


40 


.31 


.07 


.03 


.22 


.06 


.03 


100 


60 


.31 


.07 


.03 


.22 


.06 


.03 



Table 2: Limit on Branching Ratio bx as a Function of Luminosity for the Models Studied. 

to be less than about 25% at the 95% C.L. Since this branching ratio is small, we studied 
the possibility of observing the rare decay of t ^ hxi in association with the SM decay 
t bW~ bt^u (and the charge conjugate decays). Additionally, we required m ± + 
mfe. My/ + m ± + rrih > mi > m o + mc, so that the dominant stop squark decay mode 
is ii cxi- For the models studied, we found that the signal detection efficiency is 
approximately constant and almost independent of the stop or neutralino mass for the 
mass region considered. If no signal is found, we could exclude models with BR(t — > tiX?) 
larger than .33, .08 and .04 at the 3-cr level for the Tevatron with a luminosity of 200 pb~^, 
2fb~^ and lOfb"^, respectively. If a signal is found, the signal (background) event yields 
for the smallest bx are 8(5), 26(80), and 68(430) for a 200pb~\ 2fb"^ and lOfb"^ data 
sample. 

If, contrary to our assumptions about the lightest chargino, m ± + mh < mr , then the 
two body decay ii — > bxi dominates. For models discussed in Ref. Q, a light chargino 
would preferentially decay via Xi^ ~^ ff'Xi- The final state is similar to that from the SM 
decay, but the xf decay products are softer and have a lower acceptance. It is therefore 
better to detect the light chargino directly from chargino pair production than from the top 
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quark decay. 

In conclusion, we find that the prospect to observe a light stop at the Tevatron is very 
promising. Unless a stop signal can be found in the current or upcoming data at the 
Tevatron, it will be difficult to reconcile experiment with low energy Supersymmetry in the 
case that t hxi ~^ (^XiXi is the dominant non-SM decay mode. 
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